Gaze-contingent perceptually enabled interactions in the operating theatre.

PURPOSE: Improved surgical outcome and patient safety in the operating theatre are constant challenges. We hypothesise that a framework that collects and utilises information -especially perceptually enabled ones-from multiple sources, could help to meet the above goals. This paper presents some core functionalities of a wider low-cost framework under development that allows perceptually enabled interaction within the surgical environment. METHODS: The synergy of wearable eye-tracking and advanced computer vision methodologies, such as SLAM, is exploited. As a demonstration of one of the framework's possible functionalities, an articulated collaborative robotic arm and laser pointer is integrated and the set-up is used to project the surgeon's fixation point in 3D space. RESULTS: The implementation is evaluated over 60 fixations on predefined targets, with distances between the subject and the targets of 92-212 cm and between the robot and the targets of 42-193 cm. The median overall system error is currently 3.98 cm. Its real-time potential is also highlighted. CONCLUSIONS: The work presented here represents an introduction and preliminary experimental validation of core functionalities of a larger framework under development. The proposed framework is geared towards a safer and more efficient surgical theatre

Shape sensing of variable stiffness soft robots using electrical impedance tomography

Soft robotic systems offer benefits over traditional rigid systems through reduced contact trauma with soft tissues and by enabling access through tortuous paths in minimally invasive surgery. However, the inherent deformability of soft robots places both a greater onus on accurate modelling of their shape, and greater challenges in realising intraoperative shape sensing. Herein we present a proprioceptive (self-sensing) soft actuator, with an electrically conductive working fluid. Electrical impedance measurements from up to six electrodes enabled tomographic reconstructions using Electrical Impedance Tomography (EIT). A new Frequency Division Multiplexed (FDM) EIT system was developed capable of measurements of 66 dB SNR with 20 ms temporal resolution. The concept was examined in two two-degree-of-freedom designs: a hydraulic hinged actuator and a pneumatic finger actuator with hydraulic beams. Both cases demonstrated that impedance measurements could be used to infer shape changes, and EIT images reconstructed during actuation showed distinct patterns with respect to each degree of freedom (DOF). Whilst there was some mechanical hysteresis observed, the repeatability of the measurements and resultant images was high. The results show the potential of FDM-EIT as a low-cost, low profile shape sensor in soft robots

Cable-driven parallel robot assisted confocal imaging of the larynx

LaryngoTORS, a transoral laryngeal surgery robot, can manipulate instruments accurately. Confocal imaging has potentials in laryngeal cancer diagnosis but suffer from high scanning requirement. This work studies using LaryngoTORS to assist confocal imaging of larynx

Collaborative Gaze Channelling for Improved Cooperation During Robotic Assisted Surgery

The use of multiple robots for performing complex tasks is becoming a common practice for many robot applications. When different operators are involved, effective cooperation with anticipated manoeuvres is important for seamless, synergistic control of all the end-effectors. In this paper, the concept of Collaborative Gaze Channelling (CGC) is presented for improved control of surgical robots for a shared task. Through eye tracking, the fixations of each operator are monitored and presented in a shared surgical workspace. CGC permits remote or physically separated collaborators to share their intention by visualising the eye gaze of their counterparts, and thus recovers, to a certain extent, the information of mutual intent that we rely upon in a vis-à-vis working setting. In this study, the efficiency of surgical manipulation with and without CGC for controlling a pair of bimanual surgical robots is evaluated by analysing the level of coordination of two independent operators. Fitts' law is used to compare the quality of movement with or without CGC. A total of 40 subjects have been recruited for this study and the results show that the proposed CGC framework exhibits significant improvement (p<0.05) on all the motion indices used for quality assessment. This study demonstrates that visual guidance is an implicit yet effective way of communication during collaborative tasks for robotic surgery. Detailed experimental validation results demonstrate the potential clinical value of the proposed CGC framework. © 2012 Biomedical Engineering Society.link_to_subscribed_fulltex

Ex vivo modelling of drug efficacy in a rare metastatic urachal carcinoma

Background Ex vivo drug screening refers to the out-of-body assessment of drug efficacy in patient derived vital tumor cells. The purpose of these methods is to enable functional testing of patient specific efficacy of anti-cancer therapeutics and personalized treatment strategies. Such approaches could prove powerful especially in context of rare cancers for which demonstration of novel therapies is difficult due to the low numbers of patients. Here, we report comparison of different ex vivo drug screening methods in a metastatic urachal adenocarcinoma, a rare and aggressive non-urothelial bladder malignancy that arises from the remnant embryologic urachus in adults. Methods To compare the feasibility and results obtained with alternative ex vivo drug screening techniques, we used three different approaches; enzymatic cell viability assay of 2D cell cultures and image-based cytometry of 2D and 3D cell cultures in parallel. Vital tumor cells isolated from a biopsy obtained in context of a surgical debulking procedure were used for screening of 1160 drugs with the aim to evaluate patterns of efficacy in the urachal cancer cells. Results Dose response data from the enzymatic cell viability assay and the image-based assay of 2D cell cultures showed the best consistency. With 3D cell culture conditions, the proliferation rate of the tumor cells was slower and potency of several drugs was reduced even following growth rate normalization of the responses. MEK, mTOR, and MET inhibitors were identified as the most cytotoxic targeted drugs. Secondary validation analyses confirmed the efficacy of these drugs also with the new human urachal adenocarcinoma cell line (MISB18) established from the patient’s tumor. Conclusions All the tested ex vivo drug screening methods captured the patient’s tumor cells’ sensitivity to drugs that could be associated with the oncogenic KRASG12V mutation found in the patient’s tumor cells. Specific drug classes however resulted in differential dose response profiles dependent on the used cell culture method indicating that the choice of assay could bias results from ex vivo drug screening assays for selected drug classes

Tactile sensor for minimally invasive surgery using Electrical Impedance Tomography

Whilst offering numerous benefits to patients, minimally invasive surgery (MIS) has a disadvantage in the loss of tactile feedback to the surgeon, traditionally offering valuable qualitative tissue assessment, such as tumour identification and localisation. Tactile sensors aim to overcome this loss of sensation by detecting tissue characteristics such as stiffness, composition and temperature. Tactile sensors have previously been incorporated into MIS robotic end effectors, which require lengthy scanning procedures due to localised sensitivity. Distributed tactile sensors, or “artificial skin” offer a map of tissue properties in a single instance but are often not suitable for MIS applications due to limited biocompatibility or large collapsed volumes. We propose a deployable, soft, tactile sensor with a deformable saline chamber and integrated Electrical Impedance Tomography (EIT) electrodes. During contact with tissue, the saline is displaced from the chamber and the lesion size and stiffness can be inferred from the resultant impedance changes. Through optimisation of the EIT measurement protocol and hardware the sensor was capable of localising the centre of mass of palpation targets within 1.5 mm in simulation and 2.3–4.6mm in phantom experiments. Reconstructed image metrics differentiated target objects from 8–30 mm